Introducing visual cues in acoustic-
نویسنده
چکیده
The contribution of facial measures in a statistical acoustic-toarticulatory inversion has been investigated. The tongue contour was estimated using a linear estimation from either acoustics or acoustics and facial measures. Measures of the lateral movement of lip corners and the vertical movement of the upper and lower lip and the jaw gave a substantial improvement over the audio-only case. It was further found that adding the corresponding articulatory measures that could be extracted from a profile view of the face; i.e. the protrusion of the lips, lip corners and the jaw, did not give any additional improvement of the inversion result. The present study hence suggests that audiovisual-to-articulatory inversion can as well be performed using front view monovision of the face, rather than stereovision of both the front and profile view.
منابع مشابه
Designing and Evaluation of Reliability and Validity of Visual Cue-Induced Craving Assessment Task for Methamphetamine Smokers
A B S T R A C TIntroduction: Craving to methamphetamine is a significant health concern and exposure to methamphetamine cues in laboratory can induce craving. In this study, a task designing procedure for evaluating methamphetamine cue-induced craving in laboratory conditions is examined. Methods: First a series of visual cues which could induce craving was identified by 5 discussion sessions b...
متن کاملAcute and Chronic Effect of Acoustic and Visual Cues on Gait Training in Parkinson's Disease: A Randomized, Controlled Study.
In this randomized controlled study we analyse and compare the acute and chronic effects of visual and acoustic cues on gait performance in Parkinson's Disease (PD). We enrolled 46 patients with idiopathic PD who were assigned to 3 different modalities of gait training: (1) use of acoustic cues, (2) use of visual cues, or (3) overground training without cues. All patients were tested with kinem...
متن کاملAcoustic effects of visual beats
Speakers employ acoustic cues (pitch accents) to indicate that a word is important, but may also use visual cues (such as manual beat gestures, head nods, and eyebrow movements) for this purpose. Even though these acoustic and visual cues are related, the exact nature of this relationship is far from well understood. We investigate whether producing a visual beat leads to changes in how acousti...
متن کاملDissecting and validating the salience of recognition cues used by female zebra finches’ to discriminate con- and heterospecific males
Successful sexual reproduction relies on accurate mate selection criteria, including correct species recognition [1, 2]. In studying species recognition in birds, video playback of visual and/or acoustic cues can be a valuable method for investigating the relative importance of these sensory cues in the recognition process by allowing independent manipulation of the two communication modes. Des...
متن کاملIntroducing visual cues in acoustic-to-articulatory inversion
The contribution of facial measures in a statistical acoustic-toarticulatory inversion has been investigated. The tongue contour was estimated using a linear estimation from either acoustics or acoustics and facial measures. Measures of the lateral movement of lip corners and the vertical movement of the upper and lower lip and the jaw gave a substantial improvement over the audio-only case. It...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2005